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Amendments 

[1] This office action is responsive to First Preliminary Amendment received on February 8, 
2005. Claims 1-31 and 33-36 remain pending; claim 32 cancelled. 

Foreign Priority 

[2] Receipt is acknowledged of papers submitted under 35 U.S.C. 1 19(a)-(d) (J.P. App. No. 
2002022012, filed February 8, 2005; and J.P. App. No. 2002233130, filed February 8, 2005), 
which papers have been placed of record in the file. 

[3] As recited in M.P.E.P. § 1893 titled "BENEFIT CLAIM UNDER 35 USC 1 19(e), OR 
120 AND 365(c)": 

The national stage application must contain a reference to the prior nonprovisional or international 
application (either in an application data sheet (37 CFR 1.76 or in the first sentence(s) of the 
specification), identifying it by application number (series code and serial number) or international 
application number and international filing data and indicating the relationship of the applications. 
The required reference to the earlier filed application must be submitted within the later of four 
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months from the data on which the national stage commenced under 35 USC 371(b) or (f) or 
sixteen months from the filing date of the prior- filed application. 

M.P.E.P. § 1893.03(c). 

It is advised to add the reference to the prior international application in the first sentence of the 
specification. 

Specification 

[4] The title of the invention is not descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. 

[5] The following is a quote from M.P.E.P. § 608.01(b) titled "Abstract of the Disclosure": 

The form and legal phraseology often used in patent claims, such as "means" and "said," should 
be avoided. 

M.P.E.P. § 608.01(b)(C). 

The abstract is suggested to not contain "legal phraseology often used in patent claims, 

such as 'means' ". Id. 

Claim Rejections - 35 USC § 112 
[6] The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

Claims 1-36 are rejected under 35 U.S.C. 1 12, second paragraph, as failing to set forth 
the subject matter which applicants regard as their invention. 

Claim 4 cites "wherein the background image is photographed immediately before or 
immediately after the standard image is photographed", but does not consider that claim 1 allows 
the possibility that the standard image is the background image. 
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Claims 8 and 26-27 cite "and/or" but it is unclear whether it is "and" or "or", as "or" has 
been assumed for examination purposes. Claims 9-15 are rejected for failing to cure the 
deficiency of their dependent. 
Lack o f Antecedent Basis 

Claims 1, 16-17, and 30 recite the limitation "the amount of correction". There is 
insufficient antecedent basis for this limitation in the claim. Claims 2-15 and 18-29 are rejected 
for failing to cure the deficiency of their dependent. 

Claims 1 and 16 recite the limitation "the other two images", and similarly claim 17 
recites "the other of the first object image or the second object". There is insufficient antecedent 
basis for this limitation in the claim. Claims 2-15 and 18-29 are rejected for failing to cure the 
deficiency of their dependent. 

Claim 3 recites the limitation "the other". There is insufficient antecedent basis for this 
limitation in the claim. Claim 4 is rejected for failing to cure the deficiency of their dependent. 

Claims 8 and 9 recite the limitation "the user". There is insufficient antecedent basis for 
this limitation in the claim. Claims 10-15 are rejected for failing to cure the deficiency of their 
dependent. 

Claim 25 recites the limitation "the number of regions". There is insufficient antecedent 
basis for this limitation in the claim. Claims 26-29 are rejected for failing to cure the deficiency 
of their dependent. 

Claim Objections 

Failure to Further Limit 
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[7] Claim 5 is objected to under 37 CFR 1 .75(c), as being of improper dependent form for 
failing to further limit the subject matter of a previous claim. Applicant is required to cancel the 
claim(s), or amend the claim(s) to place the claim(s) in proper dependent form, or rewrite the 
claim(s) in independent form. 

It is inherent that the "superimpose [ing of] the standard image and the other one or two 
corrected images [occur] respectively at predetermined transmittances " (emphasis added) 
Improper Multiple Dependent 

[8] Claims 15 and 31 is objected to under 37 CFR 1 .75(c) as being in improper form because 
a multiple dependent claim should refer to other claims in the alternative only. See MPEP 
§ 608.01(n). Accordingly, the claim has not been further treated on the merits. 

Claim Rejections - 35 USC § 101 
[9] 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Judicial Exception - Abstract Idea 

Claims 16, 30, and 33 are rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non- statutory subject matter. 

A judicial exception claim is non-statutory for solely embodying an abstract idea, natural 
phenomenon, or law of nature. See M.P.E.P. § 2106(IV)(C)(2). However, a practical application 
of a judicial exception claim is a § 101 statutory claim "when it: 

(A) 'transforms' an article or physical object to a different state or thing [{i.e., a physical 
transformation, see below)]; or 

(B) otherwise produces a useful, concrete and tangible result, based on the factors 
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discussed below. . . ." Id. 

§ 101 statutory transformations of intangible articles or physical objects must be physical 

transformations (i.e., a physical component to the transformation must be involved). See 

M.P.E.P. § 2106(IV)(C)(2) (requiring the element "provides a transformation or reduction of an 

article to a different state of thing", a "practical application by physical transformation") and 

Interim Guidelines for Examination of Patent Applications for Patent Subject Matter Eligibility , 

Official Gazette notice, 22 November 2005, Annex (II)(B)(iii); (III). 

In Re Bilski - "Tied To " Criteria 

[10] In addition with respect to claims 16, 30, and 33, while the claims recite a series of steps 
or acts to be performed, a statutory "process" under 35 U.S.C. 101 must (1) be tied to another 
statutory category (such as a particular apparatus), or (2) transform underlying subject matter 
(such as an article or material) to a different state or thing. See Clarification of "Processes" 
under 35 U.S.C. 101 , Deputy Commissioner for Patent Examining Policy, John J. Love, May 15, 
2008; available at 

http://www.uspto.gov/web/offices/pac/dapp/opla/preognotice/section 101 05 15 2008.pdf 

The instant claims neither transform underlying subject matter nor positively tie to 
another statutory category that accomplishes the claimed method steps, and therefore do not 
qualify as a statutory process. 

Claim Rejections - 35 U.S.C. § 102 

[11] The following is a quotation of the appropriate paragraphs of 35 U.S.C. § 102 that form 
the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
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(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application lor patent in the United 
States. 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent granted 
on an application for patent by another filed in the United States before the invention by the applicant 
for patent, except that an international application filed under the treaty defined in section 351(a) shall 
have the effects for purposes of this subsection of an application filed in the United States only if the 
international application designated the United States and was published under Article 21(2) of such 
treaty in the English language. 

Katavama et al. 

[12] Claims 1-6, 16-21, 30-31 and 33-36 are rejected under 35 U.S.C. § 102(b) as being 
anticipated by U.S. Pat. No. 6,389,179 (issued May 14, 2002, hereinafter "Katayama et al") 

Regarding claim 1, Katayama et al. discloses image combination device (fig. 1), 
comprising: 

amount of background correction calculating means ("camera system 100, an image 
combining apparatus 1 72 comprises a computer, and operates in accordance with pre-set 
programs" at 9:15-18) for calculating an amount of background correction ("density level 
correct" at fig. 14, item 192a) or reading out the amount of background correction after the 
amount of background correction is calculated and recorded, the background correction being 
performed among 

(i) a background image (fig. 7, item 122), which is an image of a background, 

(ii) a first object image (fig. 7, item 121), which includes at least a part of the 
background and a first object (the isolated hill of fig. 7, item 121), and 

(iii) a second object image (fig. 7, item 123), which includes at least a part of the 
background and a second object (the isolated sun of fig. 7, item 123), 
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the amount of background correction ("density level correct" at fig. 14, item 192a; also 
"transforming processing" at 10:63-1 1 :3) being one or a combination of relative amounts 
including an amount of movement, an amount of rotation, a rate of expansion or reduction, and 
an amount of distortion correction (density level correction is a form of "an amount of distortion 
correction"; also "transforming processing" is a form of "trapezoidal distortion" correction) from 
the panoramic views, with respect to a background; and 

superimposed image generating means ("[t]he computer 30 is programmed to implement 
the invention" at para.0025) for generating a superimposed image (fig. 8, item 124) by using one 
of the background image, the first object image, and the second object image as a standard image 
(fig. 7, item 122 was the standard image because both 121 and 123 applied to 122), 

correcting the other two images (fig. 7, items 121, 123) by the amount of correction 
(density level correction is a form of "an amount of distortion correction"; also "transforming 
processing" is a form of "trapezoidal distortion" correction) obtained from the amount of 
background correction calculating means, the other two images being corrected so that 
backgrounds (the background elements in items 121, 123 at fig. 7), other than objects (the isolated 
hill of item 121 at fig. 7; the sun of item 123 at fig. 7), of the other two images correspond to the 
standard image at least partially (R24, R42 at fig. 15), and superimposing (fig. 8, item 124) the 
standard image (fig. 7, item 122) and one or both of the other two images (fig. 7, items 121, 123). 

Regarding claim 2, Katayama et al. discloses further comprising: 

image pickup means (fig. 6, item 100) for picking up an image of an object or a scene 
(fig. 6, item 20), the background image (fig. 7, item 122), the first object image (fig. 7, item 121), 
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or the second object image (fig. 7, item 123) being generated based on an output of the image 
pickup means. 

Regarding claim 3, Katayama et al. discloses wherein: 

the first object image (fig. 7, item 121) or the second object image (fig. 7, item 123) that is 
photographed earlier (it is suggested that item 121 or item 123 was photographed first) than the 
other is used as the standard image (fig. 7, item 122). 

Regarding claim 4, Katayama et al. discloses wherein: the background image is 
photographed immediately before or immediately after the standard image is photographed [see 
§112 rejection above]. 

Regarding claim 5, Katayama et al. discloses wherein: the superimposed image 
generating means superimposes the standard image and the other one or two corrected images 
respectively at predetermined transmittances [see § 1.75(c) claim objections above]. 

Regarding claim 6, Katayama et al. discloses wherein: 

the superimposed image generating means ("[t]he computer 30 is programmed to 
implement the invention" at para.0025) generates a difference image ("transforming processing" 
is a form of "trapezoidal distortion" correction to convert item L23 to item 123 at fig. 7, the 
difference image being item 123 after trapezoidal distortion correction; the "difference" being a 
difference between L23 and its calculated trapezoidal distortion) from the standard image (fig. 7, 
item 122) and the other one or two corrected images (fig. 7, items 121, 123), and 

a region in the difference image (e.g., fig. 7, item 121) that has a difference is generated 
as an image having a pixel value that is different (the "difference" being a difference between 
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L23 and its calculated trapezoidal distortion) from an original pixel value (the pixel values in 
itemL21 of fig. 7). 

Regarding claim 16, claim 1 recites identical features as in claim 16. Thus, 
references/arguments equivalent to those presented above for claim 1 are equally applicable to 
claim 16. 

Regarding claim 17, claim 1 recites identical features as in claim 17. Thus, 
references/arguments equivalent to those presented above for claim 1 are equally applicable to 
claim 17. 

Regarding claim 18, claim 2 recites identical features as in claim 18. Thus, 
references/arguments equivalent to those presented above for claim 2 are equally applicable to 
claim 18. 

Regarding claim 19, claim 3 recites identical features as in claim 19. Thus, 
references/arguments equivalent to those presented above for claim 3 are equally applicable to 
claim 19. 

Regarding claim 20, claim 5 recites identical features as in claim 20. Thus, 
references/arguments equivalent to those presented above for claim 5 are equally applicable to 
claim 20. 

Regarding claim 21, claim 6 recites identical features as in claim 21. Thus, 
references/arguments equivalent to those presented above for claim 6 are equally applicable to 
claim 21. 
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Regarding claim 30, claim 1 recites identical features as in claim 30. Thus, 
references/arguments equivalent to those presented above for claim 1 are equally applicable to 
claim 30. 

Regarding claim 31, Katayama et al. discloses an image combination program ("camera 
system 100, an image combining apparatus 172 comprises a computer, and operates in 
accordance with pre-set programs" at 9:15-18) for causing a computer to function as each means 
of the image combination device as set forth in claims 1 and 17. 

Regarding claim 33, Katayama et al. discloses image combination program ("camera 
system 100, an image combining apparatus 172 comprises a computer, and operates in 
accordance with pre-set programs" at 9:15-18) for causing a computer to execute each step of the 
image combination method as set forth in claim 16 or claim 30. 

Regarding claim 34, Katayama et al. discloses a recording medium (fig. 1, item 130) 
containing the image combination program as set forth in claim 3 1 . 

Regarding claim 35, Katayama et al. discloses recording medium (fig. 1, item 130) 
containing the image combination program as set forth in claim 33. 

Regarding claim 36, Katayama et al. discloses recording medium (fig. 1, item 130) 
containing the image combination program as set forth in claim 33. 

Claim Rejections - 35 U.S.C. § 103 
[13] The following is a quotation of 35 U.S.C. § 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 
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Katavama et al. in view of Nakamura et al. 

[14] Claims 7-10, 13-14, 22, and 25-29 are rejected under 35 U.S.C. § 103(a) as being 
unpatentable over U.S. Pat. No. 6,389,179 (issued May 14, 2002, hereinafter "Katayama et al") 
in view of U.S. Patent No. 6,005,987 (issued Dec. 21, 1999, hereinafter "Nakamura et al"). 

Regarding claim 7, Katayama et al. does not disclose further comprising: object region 
extracting means for extracting a region of a first object and a region of a second object from a 
difference image generated from a standard image and the other one or two corrected images, the 
superimposed image generating means superimposing the standard image and the regions of the 
one or two corrected images obtained from the object region extracting means, instead of 
superimposing the standard image and the one or two corrected images. 

Nakamura et al. teaches object region extracting means (25:18-28) for extracting a region 
(the outline of item 3 17 in fig. 1 lh for which the arrow is pointed to) of a first object (item 3 17 in 
fig. 1 1 c) and a region (item 3 1 8 in fig. 1 1 f) of a second object (fig. 1 lb, item 3 1 8) from a 
difference image (fig. 1 If) generated from a standard image (the standard image of fig. 11a and 
1 lb) and the other one or two corrected images, 

the superimposed image generating means (25:18-28) superimposing (fig. 1 li) the 
standard image and the regions of the one or two corrected images obtained from the object 
region extracting means, instead of superimposing the standard image and the one or two 
corrected images. 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made for the image combination device of Katayama et al. to include further comprising: 
object region extracting means for extracting a region of a first object and a region of a second 
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object from a difference image generated from a standard image and the other one or two 
corrected images, the superimposed image generating means superimposing the standard image 
and the regions of the one or two corrected images obtained from the object region extracting 
means, instead of superimposing the standard image and the one or two corrected images as 
taught by Nakamura et al. so that "to provide a picture image forming apparatus in which in 
imaging a scene by a camera or the like, in the case where movement of the lens center of the 
camera is unavoidable, picture images taken by the camera, including a parallax caused by a 
difference in depth of an object are composited to obtain a composite picture image having 
inconsiderable deterioration in picture image quality caused by a shift in the image of the object 
or doubled imaging of images of the object." Nakamura et al. at 3:3-13. 

Regarding claims 8 and 9, Katayama et al. in view of Nakamura et al. do not disclose 
further comprising: overlap detecting means for detecting overlap between the region of the first 
object and the region of the second object obtained from the object region extracting means. 

Nakamura et al. teaches further comprising: 

overlap detecting means (25: 18-28) for detecting overlap (fig. 1 lh) between the region of 
the first object and the region of the second object obtained from the object region extracting 
means. The overlap detecting means is an overlap warning means for warning the user and/or 
the object that there is overlap (because fig. 1 lh "warns" that there is overlap), when overlap is 
detected by the overlap detecting means. 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made for the image combination device of Katayama et al. in view of Nakamura et al. to 
include further comprising: overlap detecting means for detecting overlap between the region of 
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the first object and the region of the second object obtained from the object region extracting 
means (overlap detecting means is an overlap warning means for warning the user and/or the 
object that there is overlap, when overlap is detected by the overlap detecting means) as taught 
by Nakamura et al. so that "to provide a picture image forming apparatus in which in imaging a 
scene by a camera or the like, in the case where movement of the lens center of the camera is 
unavoidable, picture images taken by the camera, including a parallax caused by a difference in 
depth of an object are composited to obtain a composite picture image having inconsiderable 
deterioration in picture image quality caused by a shift in the image of the object or doubled 
imaging of images of the object." Nakamura et al. at 3:3-13. 

Regarding claim 10, Katayama et al. discloses shutter release timing notifying means 
(25:18-28) for notifying the user (fig. 1 lh would depict overlap or no overlap, and thus notifying 
the user when the user looks at the image itself) and/or the object that there is no overlap (fig. 
1 lh), when no overlap is detected by the overlap detecting means (25:18-28). 

Regarding claim 13, Katayama et al. in view of Nakamura et al. do not disclose wherein: 
the overlap detecting means extracts an overlap region where the region of the first object and 
the region of the second object overlap. 

Nakamura et al. teaches wherein: the overlap detecting means (25:18-28) extracts an 
overlap region (fig. 1 lh) where the region of the first object (item 3 17 in fig. 11c) and the region 
of the second object (item 318 in fig. 1 If) overlap (they overlap in fig. 1 If, and fig. 1 lh). 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made for the image combination device of Katayama et al. in view of Nakamura et al. to 
include wherein: the overlap detecting means extracts an overlap region where the region of the 
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first object and the region of the second object overlap as taught by Nakamura et al. so that "to 
provide a picture image forming apparatus in which in imaging a scene by a camera or the like, 
in the case where movement of the lens center of the camera is unavoidable, picture images 
taken by the camera, including a parallax caused by a difference in depth of an object are 
composited to obtain a composite picture image having inconsiderable deterioration in picture 
image quality caused by a shift in the image of the object or doubled imaging of images of the 
object." Nakamura et al. at 3:3-13. 

Regarding claim 14, Katayama et al. in view of Nakamura et al. do not disclose wherein: 
the superimposed image generating means generates the superimposed image in such a manner 
that the overlap region extracted by the overlap detecting means has a pixel value that is different 
from an original pixel value. 

Nakamura et al. teaches wherein: the superimposed image generating means (25:18-28) 
generates the superimposed image (fig. 1 li) in such a manner that the overlap region (fig. 1 lh) 
extracted by the overlap detecting means (25:18-28) has a pixel value (fig. 1 lh contains at least 
one pixel value that is different than fig. 1 li) that is different from an original pixel value. 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made for the image combination device of Katayama et al. in view of Nakamura et al. to 
include wherein: the superimposed image generating means generates the superimposed image in 
such a manner that the overlap region extracted by the overlap detecting means has a pixel value 
that is different from an original pixel value as taught by Nakamura et al. so that "to provide a 
picture image forming apparatus in which in imaging a scene by a camera or the like, in the case 
where movement of the lens center of the camera is unavoidable, picture images taken by the 
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camera, including a parallax caused by a difference in depth of an object are composited to 
obtain a composite picture image having inconsiderable deterioration in picture image quality 
caused by a shift in the image of the object or doubled imaging of images of the object." 
Nakamura et al. at 3:3-13. 

Regarding claim 22, claim 7 recites identical features as in claim 22. Thus, 
references/arguments equivalent to those presented above for claim 7 are equally applicable to 
claim 22. 

Regarding claim 25, Katayama et al. in view of Nakamura et al. do not disclose further 
comprising: overlap detecting means that judges that the region of the first object and the region 
of the second object overlap, when the number of regions of the first object or the second object 
obtained from the object region extracting means does not correspond to a value set as the 
number of objects to be combined. 

Nakamura et al. teaches further comprising: 

overlap detecting means (25: 18-28) that judges that the region of the first object (item 
317 in fig. 11c) and the region of the second object (item 318 in fig. 1 If) overlap, when the 
number of regions of the first object or the second object obtained from the object region 
extracting means (25:18-28) does not correspond to a value set (infinity) as the number of 
objects to be combined. 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made for the image combination device of Katayama et al. in view of Nakamura et al. to 
include further comprising: overlap detecting means (25:18-28) that judges that the region of the 
first object and the region of the second object overlap (as shown in fig. 1 If, 1 lh), when the 
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number of regions (23:57-24:10) of the first object or the second object obtained from the object 
region extracting means (25:18-28) does not correspond to a value set (23:57-24:10) as the 
number of objects to be combined as taught by Nakamura et al. so that "to provide a picture 
image forming apparatus in which in imaging a scene by a camera or the like, in the case where 
movement of the lens center of the camera is unavoidable, picture images taken by the camera, 
including a parallax caused by a difference in depth of an object are composited to obtain a 
composite picture image having inconsiderable deterioration in picture image quality caused by a 
shift in the image of the object or doubled imaging of images of the object." Nakamura et al. at 
3:3-13. 

Regarding claim 26, claim 9 recites identical features as in claim 26. Thus, 
references/arguments equivalent to those presented above for claim 9 are equally applicable to 
claim 26. 

Regarding claim 27, claim 10 recites identical features as in claim 27. Thus, 
references/arguments equivalent to those presented above for claim 10 are equally applicable to 
claim 27. 

Regarding claim 28, claim 1 1 recites identical features as in claim 28. Thus, 
references/arguments equivalent to those presented above for claim 1 1 are equally applicable to 
claim 28. 

Regarding claim 29, claim 12 recites identical features as in claim 29. Thus, 
references/arguments equivalent to those presented above for claim 12 are equally applicable to 
claim 29. 
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Conclusion 

[15] The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. US 5465163 A; US 5786847 A; US 5838837 A; US 5999662 A; US 6205259 Bl; US 
6215914 Bl; US 6292593 Bl; US 20020097920 Al; US 6429895 Bl; US 6466262 Bl; US 
6516154 Bl; US 6549681 Bl; US 20030103683 Al; US 20030219146 Al; US 6798923 Bl. 
[16] Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DAVID P. RASHID whose telephone number is (571)270-1578 
and fax number (571)270-2578. The examiner can normally be reached Monday - Friday 7:30 - 
17:00 ET. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vikkram Bali can be reached on (571) 272-7415. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 

Application Information Retrieval (PAIR) system. Status information for published applications 

may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 

applications is available through Private PAIR only. For more information about the PAIR 

system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 

system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 

like assistance from a USPTO Customer Service Representative or access to the automated 

information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/TtavidT. Hashid/ 
Examiner, Art Unit 2624 

David P Rashid 
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